validity evidences in test development : an applied perspective

نویسندگان

  • Hugo Carretero-Dios
  • Willibald Ruch
چکیده

The purpose of this instrumental study was to show how to conduct a study aimed at obtaining content validity evidence in the test construction/adaptation process. An applied perspective was used, and this paper presents the content validity analysis of the Spanish adaptation of the State-Trait Cheerfulness Inventory trait form (STCI-T). This paper illustrates the stages required to analyze content validity: 1) definition of the content domain to be assessed, 2) item construction, and 3) expert judgment of the items constructed. This study focused mainly on the third stage and the results obtained with a previously selected panel of experts are included. The paper briefly describes the most important criteria to consider in the selection of experts, the procedure recommended to obtain judgments, the material to administer, aspects of items to assess, and the type of analyses that should be conducted. Based on the results obtained for the Spanish adaptation of the STCI-T, the article discusses the importance of obtaining content validity evidence in the test construction/adaptation process. The indices used demonstrated good content validity for the Spanish version of the STCI-T. Posted at the Zurich Open Repository and Archive, University of Zurich ZORA URL: https://doi.org/10.5167/uzh-64551 Published Version Originally published at: Delgado-Rico, Elena; Carretero-Dios, Hugo; Ruch, Willibald (2012). Content validity evidences in test development: an applied perspective. International Journal of Clinical and Health Psychology España, 12(3):449-460. Content validity evidences in test development: An applied perspective1 Elena Delgado-Rico (University of Granada, Spain), Hugo Carretero-Dios2 (Universidad de Granada, Spain), and Willibald Ruch (University of Zurich, Switzerland) ABSTRACT. The purpose of this instrumental study was to show how to conduct a study aimed at obtaining content validity evidence in the test construction/adaptation process. An applied perspective was used, and this paper presents the content validity analysis of the Spanish adaptation of the State-Trait Cheerfulness Inventory trait form (STCI-T). This paper illustrates the stages required to analyze content validity: 1) definition of the content domain to be assessed, 2) item construction, and 3) expert judgment of the items constructed. This study focused mainly on the third stage and the results obtained with a previously selected panel of experts are included. The paper briefly describes the most important criteria to consider in the selection of experts, the procedure recommended to obtain judgments, the material to administer, aspects of items to assess, and the type of analyses that should be conducted. Based on the results obtained for the Spanish adaptation of the STCI-T, the article discusses the importance of obtaining content validity evidence in the test construction/adaptation process. The indices used demonstrated good content validity for the Spanish version of the STCI-T. The purpose of this instrumental study was to show how to conduct a study aimed at obtaining content validity evidence in the test construction/adaptation process. An applied perspective was used, and this paper presents the content validity analysis of the Spanish adaptation of the State-Trait Cheerfulness Inventory trait form (STCI-T). This paper illustrates the stages required to analyze content validity: 1) definition of the content domain to be assessed, 2) item construction, and 3) expert judgment of the items constructed. This study focused mainly on the third stage and the results obtained with a previously selected panel of experts are included. The paper briefly describes the most important criteria to consider in the selection of experts, the procedure recommended to obtain judgments, the material to administer, aspects of items to assess, and the type of analyses that should be conducted. Based on the results obtained for the Spanish adaptation of the STCI-T, the article discusses the importance of obtaining content validity evidence in the test construction/adaptation process. The indices used demonstrated good content validity for the Spanish version of the STCI-T.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Explaining the Current and Ideal Situation of the Education Development Centers from the Perspective of Faculty Members: A Quantitative Study

Introduction: Since the education development center are the masterminds in the body of higher education in medical universities, the purpose of this study was to examine the current and ideal situation of the education development centers from university faculty members’ perspective. Methods: The present study is a descriptive cross-sectional study that was conducted in 1396 at the level of me...

متن کامل

Validity and Reliability Reports in Applied Linguistics Research Articles: The case of tests and questionnaire

This study intended to determine the way validity and reliability i.e., psychometric properties were reported in the Applied Linguistics research articles. The study also focused on the measurement methods applied to determine the validity and reliability of the scores derived from the tests and questionnaires in the empirical studies. The corpus of the study included 331 empirical studies deri...

متن کامل

Development, psychometric properties and new validity evidences of the web-based computerized adaptive test of English eCat

This paper describes the process of constructing the eCat test and provides information on the effects its normal operation had on its psychometric properties. Results obtained from 3224 students revealed that the 225 item pool has adequate reliability and good convergent validity with respect to self-reported English proficiency. Simulations showed that ability estimations are essentially unbi...

متن کامل

Establishing an Argument-Based Validity Approach for a Low-Stake Test of Collocational Behavior

Most of the validation studies conducted across varying test application contexts are usually framed within the traditional conceptualization of validity and therefore lack a comprehensive framework to focus on test score interpretations and test score use. This study aimed at developing and validating a collocational behavior test (CBT), drawing on Kane's argument-based approach to validity. F...

متن کامل

Validity Evidence in Scale Development: The Application of Cross Validation and Classification-Sequencing Validation

The validity of measuring devices used in education is one of the most important topics of the measuring device development process. Validity concept is a criterion for the fact that it serves as a measuring device (Croker & Algina, 2008; Downing & Haladyna, 2006; Kane, 2006). In other words, identifying the degree of an expected structure and of an observed structure is the structural validity...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017